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SUMMARY 


^ny useAil mathematical models for manual control monitoring and 
ecislon-mking tasks in man-machine systems have been designed and 
ocessfully applied. However^ critical comments have occasionally been 
m**** practitioners concerned with the design of complex 

man-machine systems. They blame especially models which seem to explain 
wdil^/* subtask experiments designed particularly for these 

two approach to bridging the gap between these 

two points of view is presented. From the manifold of possible human 
tasks, a veipr popular baseline scenario has been chosen, namely car 
riving. A hierarchy of hunan activities is derived by analysing this task 

* “■•“““"l -"orlPtla. l«d. to . bl“ k dT4r« i 
time-sharing computer analogy. «nu « 

applicability of existing mathematical models is 
onsidered with respect to the hierarchy of human activities in real 

Bathematieal tools so far not often applied “o 
^-nchlne systems are discussed. The mathematical descriptions at least 
?u1*v estimation, ccmtroirqSSJeJSg, ”5 

tho^Af! “ well as artificial intelligence techniques . Some 

SrtSir wo^ “ lnt«gr.t.d and how 
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INTRODUCTION 


bhen designing such systems as automobiles, aircraft, power plants, 
and management information systems, it is very important to understand the 
human s role in the system and design the roan-madiine interface 
appropriately. The engineering approach, which leads one to represent the 
aa chine in terms of differential equations, networks, etc* suggests that 
the human can also be represented as a set of mathematical equations for 
the purpose of systems analysis and design. Thus, considerable effort has 
ceen devoted to developing mathematical models of human behavior. 


Despite the criticisms of those who find the analogy between humans 
ana equations unpalatable, many models have been reasonably successful 
within the limited domains that they addressed. In fact, if we accept the 
premise that human behavior mainly reflects the external environment [1), 
then it is not surprising that man and machine can be described in similar 
terms. Quite simfly, since the human adapts his behavior to the machine, 
his actions become somewhat maohlne-Uke. (Of course, from a design point 
of view, one tries to avoid requiring the human to adapt to the machine to 
any extreme extent.) 


On the other hand, the success of models in limited domains has not 
had substantial impact in realistically complex domains, for example, 
manual control models are not everyday tools for the aircraft designer, 
rurther, as the reader will see iwnual control models capture only a small 
portion of the toi^ task of driving an automobile. For these reasons, 
designers have been known to claim that mathematical models of human 
behavior are not particularly useAjl. While the authors only partially 
agree with this opinion, even as it relates to currently available models, 
such statements have motivated the work upon which this paper is based. 


Within this paper, the authors present a realistically complex task 
(i.e., automobile driving) and illustrate the various aspects of the task 
protocols of subjects* behavior. A hierarchy of human 
activitiee is derived by analyzing this task in general terms. A 
time*sharing computer analogy and block diagram are presented. Numerous 
rathematical methodologies appropriate to representing such a model are 
discussed* finally the state-of-the-art is summarized and the proepeots 
are considered . 


A rtfiALlSriC TASK 


In considering alternative realistic task domains, the authors 
discussed a variety of domains including aircraft piloting, industrial 
process monitoring, and automobile driving. After substantial disoussion, 
it became quite clear that the domain to whloh both the authors and 
potential readers epuld meet relate was automobile driving. 
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th« •••xperlnent" involved a hypothetical trip from the driveway of one 
author's house (GJ) to the home of the other author (V/R). Two subjects 
participated (OJ and WR). Their task was to explain ttl de tail what they 
would be doing throughout he hypothetical trip. Each subject 
independently generated a written protocol of the trip. The two resulting 
protocols were merged to produce Figure 1 . 


The activities in this figure can be categorised into several levels 
of behavior: 

1 . Reaching, twisting, and listening 

2. Steering, accelerating, and braking 
3> Looking around and estimating 

4. Updating and evaluating 

5. Planning 

6. Reflecting and daydreaming 

The authors would like to suggest that a theory of human behavior in 
realistic tasks should be able to model levels 1 through 5. In pursuit of 
this possibility, this list was somewhat compacted to yield the following 
aspects of behavior to be modeled: 

t . Sensing and interpreting inputs 
2. Planning 
3* Implementing plans 

To consider these three topics, an overall framework will be discussed in 
the next section and then, specific approaches to modeling will be 
considered in the subsecuent section. 

STRUCTURAL OBSCRIPnOR 


Looking at the hierarchy of human activities discussed above as 
information processing activities, a timers haring computer analogy seems to 
be a very appealing approach to understanding the structural 
interrelationships . 


Figure 2 shows a sketoh of such a time»8harlng computer analogy. 
There art several possibilities for the central nervous system (CHS) to 
interact with the peripheral input and output devices (i.e,, the sensory 
and the aotor systems including speech generation). The CHS is viewed as 
being divided into an operating system snd four classes of Jobs,” i.e., 
pr^raa/data files (sec, e.g., (23, (3))* Hereby, a multi-processor system 
allowing a mixture of parallel and serial information processing is most 
likely to be a reasonable assumption for the human operator (‘•I . 

The operating system is responsible for scheduling the programs in a 
time-slMred manner by using a priority interrupt policy. Conflicting 
criteria with respect to priority have to also be evaluated by the 
operating system. This might be a crucial task, especially in urgent 
situations. 
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Figure 1 : Protocol for Typloel City Trip 
INSERT KEX IN IGNniON 
PUT ON SEAT EELT 

PRESS CAS PEDAL TO FLOOR AND ALHOST TOTALLY RELEASE 
TUMt KEl 

LISTEN FOR ENGINE SOUND 
IF SO, THEN GIVE GAS 
ELSE, STOP AND GO BACK TO TUfM KET 
WAIT FOR CAR TO kARh UP - DAYDKEAH 

LOOK AROUND - SEE IF X CAN BACK UP OKAY - INCLUDES USING MIRRORS 
IP SO, THEN PUT CAR IN REVERSE 
ELSE, WAIT FOR ALL CLEAR 
PUT RIGHT ARM ON SEAT BACK SO AS TO SEE BETTER 
STEER WITH LEFl ARM, AOCELERATE AND BACK ONTO STREET 
DETERMINE WHEN CLEAR TO GO FORkARD « STOP BACKING UP • PRESS BRAKE 
PUT CAR IN DtaVE 

LOCK AROUND - SEE IF I CAN PROCEED 
IF SO, ACCELERATE 
ELSE, WAIT FOR ALL CLEAR 

LIMIT SPEED SINCE STOP SIGN QOHXNQ UP - CONTINUE LOOKING AROUND 
STEEN SO AS TO STAY "sORT OF* IN LANE 

ESTIMATE DISTANCE TO STOP SIGN - CHECK FOR TIME TO DECELERATE 
IP SO> REMOVE FOOT FROM GAS AND OVER TO BRAKE 

ELSE, UPDATE ESTIMATE OP OISTANCS - CONTINUE LOOKING AROUND/STBERINC 
TUM ON LeFT DIRBCnONAL 

nHEN fairly aoSE TO STOP SIGN , PUSH BRAKE HARDER AND STOP 
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LOOK LbfT AND RlGhT tOR TRAFFIC 

IF NONE TOO CLOS (EStmK IF I CNN MKE IT,. NCCSLBIUIE, TOR. LEFT 
El.SE, WAIT foR ALL CLEAN AND OONIINOE UPDAIINO ESTIHATES 
SlNAlOhnsN OOT SO AS- TO NEED "soST Of" IN LANE 

accelerate. DDT NOT TOO MUCR BECAUSE STOP SION COhlNO OP 
LOOE around at TRAFFIC . ALSO AT ROUSES AND YARDS - DAIDREAM 
EXE<STE STOP SION ROUHNE . ONE FOR S«,PPINO - ONE FOR STARTINO 

- USE FOUR-WAY STOP SIGN ROUnNE 
EXEOOE ENROUTE ROUnNE . INCLUOINO TAUCINO, SIOBTSEEINO, ETC. 


PLAN ROUTE - WHAT STREETS TO TAKE 


fiXECUTE STOP SIGN/STOP 


LIGHT/TURNING/PASSING/LANE CHANGING ROUTINES 


look around fOR APPROPRIATE PARKING SPACE 


IF ONE FOUND, DETERMINE PLAN FOR GETTING INTO IT 
else, continue LOOKINO - OJNTINUE LOOEINO AROUND AND STEERINO 
aEO,TE PLAN CPEN-LOOP, WI« FINAL UPDATES AS ERRORS CAN BE ESTIMATED 


PUT CAR IN PARK 

turn off RADIO HEATER, ETC., IF APPROPRIATE 
turn Off KEY 

REMOVE KEY 


141 







rr-^4W 

figure 2: Sketch of a Time-Sharing Computer 
rtodel ol th6 HunBn Operator 

adaptive i"„tt;rr“e a«Vun“‘*r/e r„Trau;i ‘!S 

accomplished by the operating system . paraiiei tasks has to be 

Of olaas ao7Ta^ i“«„ed ““ '"•«’*““'•«• t!'* Pr°8™«a 
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modifying it* The operating system is responsible for searching throu^ 
the knowledge base (see> e.g.) [5]) [31) • 

The time-sharing computer analogy outlined here is mainly assumed as a 
possible framewowc for future thinking about complex tnan-ipachine systems. 
To further illustrate the hierarchical multi-level structure of human 
activities within this framework, a block diagram is shown in Figure 3* 
Unly the most important information flows between the different levels are 
outlined • 



Figure 3: Hierarchical Multi-Level Structure of Human Activities 


Lower level processes (bottom of Figure 3) are normally characterized 
by events occurring at a high frequency as compared to higher level 
processes (top of Figure 3)* This refers to different time scales for 
different levels. However* because lower level processes may be 

autonomous, the difference in time scales does not mean that these 
processes have to be considered by the operating system more frequently. 

In Figure 3, planning is denoted as a major activity* With data fr<xn 
the knowledge base and those from lower-level looking around procedures, 
sometimes influenced by higher-level reflecting, planning is the 
development of procedures to achieve overall goals and subgoals for 
lower-level processes ♦ Modifying the knowledge base as well as 
goal-setting for oontrolling and reaching are shown as examples. 
Controlling itself Is also best described as a multi-level structure, being 
a subset of the overall multi-level structure of Figure 3* Controlling and 





reaching procedures result in output actiais of the human operator via 
response generation which refers to the peripheral output devices in Figure 
2 4 Correspondingly, the peripheral input devices of Figure 2 extract 
task-relevant features from sensory input informatics « This process is 
very closely linked with looking around procedures which are also indicated 
in figure 3 * 


MATH 6MTI CAL MODELS 
Sensing and Interpreting Inputs 

Heconsidering the task analysis of car driving| hov) does the driver 
recognize stop signs^ other cars^ children^ etc? Could one> at least in 
theory! develop an algorithm that successfully performs these aspects of 
driving? 

To pursue this question) the literature of pattern recognition and 
artificial intelligence was considered. Fortunately, the literature in 
these areas has recently been summarized in the Systems, Man, and 
Cybernetics Review [6], by Sklansky [7], and in books by Winston [8], [9] 
for pattern recognition and artificial intelligence respectively. 

Two approaches to pattern recognition have received particular 
attention: statistical methods and syntactical methods. The statistical 

racthods use discriminant functions to classify patterns. This involves 
extracting a set of features fr<xn the pattern and statistically determining 
how close this feature set is to the a priori known features of candidate 
classes of patterns. The class whose features most closely match the 
tiieasured features is chosen as the match to the pattern of interest* with 
of course some consideratiwi given to the a priori probabilities of each 
class and the costs of errors. 

The syntactic methods partition each pattern into subpattems or 
pattern primitives. It is assumed that a xnown set of rules (a grammar) is 
used to compose primitives into a pattern. One approach to recognizing 
primitives is to use the statistical approach noted above * 

Another aspect of pattern recognition involves image processing, 
here, each picture point (pixel) is classified according to gray level. 
Then, thresholds are used to segment the picture. More elaborate 
approaches use multi-dimensional classification of each pixel and then, use 
an appropriate fault i-dime ns ional clustering of similar pixels. 

Artificial intelligence researchers have devoted considerable effort 
to scene analysis. With emphasis on understanding scenes composed of 
somewhat arbitrary collections of blocks, methods have been developed to 
pick particular blocks out of scenes, even if the desired block is 
partially hidden. 

Most of the methods discussed above have worked reasonably well within 
limited domains. When the context within which one is working is 

well-understood, it is often possible to successfully sense and interpret 
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inputS) althou^ considerable computational power may be needed* 

advent of Inexpensive microelectronics might allow one to 

aSi ooopuftional power In a «>del of human senoln* 

and interpretation of data, there are bigger problems to be ^ived 

wS a htLrf with realistic contexts in a static manner.' 

5 ef LdThp <l^Pends on what he is looking for, what he expects to 

aspects of seeing cannot be 
iwolved! context and without reference to the specific individual 


allocfterM.^Tfl^\^®*'“’® considered the issue of how the human 

all^ates his attention among multiple displays [10], [11], [12] [13] 

iii been tested in ' fairlv 

an,ii aoairlo. " 

recognition and artifSial ^intelliSnce^^rre teVming^^ tT^^L 

S r.XJ (l7r^arpa?ool^l1:L‘”o« - 

d“?er.^o.r oohtoxt a„T ”dT,idial 

Planning 

muoh of““S^ auWaoM^' “r/fi,"”*' P'd'illy apparent that 

suojects conscious activities were devoted to develoDinv 

initiating, and monitoring plans. This observation agrees with analyse ff 

»rbal ^otooola in a.„rai other tank aomalna t1?f ” 

2 m faP “l>ich theri are mfia 

To discuss planning, one first must emphasize the distinct- im hai-uA.>.a 
*«'»«"* Plaaa and the prooeaa of 

STr^er^^TviraoVivcir 

program execution activity [ 1] * ^ iooKed at as a 


d.al,°“kh?rr u:uS," ^^"ceStTthe^trril liTaV'Tir {eTT d'^ 

aircraft), the process of developing subgoals is often 'leff u** 

L^:sra“r^"*erlo?,“^%/"‘° 

conalderable attention (19), *™j'° ’*aal mode of planning that haa received 
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The hierarchical approach allows one to develop plans that are broad 
and sketchy as opposed to detailed and concise* Thus* low level subgoals 
can be temporarily ignored until their immediacy demands attention* 
iiimilarly) future actions which require preconditions that are not as yet 
assured can perhaps be temporarily ignored if one feels that the 
environment is hospitable to one's goals [20]. 

On the other hand, low level subgoals must eventually be dealt with. 
Then, a concise system dynamics model such as Carbone 11* s probably provides 
a reasonable description of human behavior [21]. This model assumes that 
the human is dealing with a system describable by quantitative state 
transitions and amenable to quantitative control actions. 

Such low level planning is probably unconscious. B'rom the perspective 
of a computer analogy, one might say that high level conscious planning is 
like executing an interpreted program. (An Interpreted program is one 
where the computer consciously has to interpret the meeming of each 
statement as it is executed.) On the other hand, lov/ level unconscious 
planning is similar to executing a compiled program [1]. In fact, it might 
be claimed that low level planning cannot really be called planning. 
Instead, such activities are only the details of implementation, which are 
ciscussed later in this paper. 

Planning appears to include the following aspects: 

1. Generation of alternative plans, 

2. Imagining of consequences, 

3. Valuing of consequences, 

4. Choosing and initiating plan, 

5. Monitoring plan execution, 

6. Debugging and updating plan, 

where the latter three aspects deal with observing plan execution and 
subsequent replanning, but with actual Implementation* 

how might one model the generation of alternative plans? One can look 
at a plan as a linked set of subplans [20]. However, at some level, 
subplans must be specific* In many tasks, the alternatives are olearly 
defined »t the outset* On the other hand, there are many interesting tasks 
(e.g., engineering design) where the human must create alternatives. In 
such cases, humans usually first consider alternatives that have been 
successful in previous situations* 


One might use Newell's pattem*evoked production systems as a model of 
how the human accomplishes this search for alternatives [1]* A production 
is a rule consisting of a situation recognition part that is a list of 


things to watch for, and an action part that is a list of things to do* 
(The word "production", as it is used here, has absolutely nothing to do 
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As an alternative to production systems; the idea of scripts might 
provide a reasonable model, "a script is a structure that describes 
appropriate sequences of events in a particular context [22] . 

The ideas of production systems and scripts are both related to the 
idea of the human having an internal model. However^ as the reader will 
see» it is very different from the type of model assumed in the system 
dynamics domain, wamely, productions and scripts provide forecasts of 
typical consequences rather than models of internal state transitions. 


Sometimes a ngM alternative is needed and it is very difficult to say 
how a totally new idea is generated. Linking the idea of associative 
memory [23], [2i|] with the idea of product icn systems or scripts, one can 
conjecture that new ideas are generated when the criterion for matching the 
new subgoal with past experiences is relaxed and/or non-standard features 
of the situation are emphasized. 

Long-term plans that will not be immediately implemented are probably 
developed at the highest level in the goal hierarchy with only major goals 
considered, such a plan might be a somewhat vague verbal statement or 
perhaps a sketch of activities and relationships. It is interestjing to 
speculate upon (and perhaps research) what plans look like in the mind s 
eye." for example, are plans list-like or are they more spatial, such as 
Warfield s interpretive structural models [25]. 

Short-term plans that will require immediate implementation cannot be 
quite so sketchy. In this case, the human has to consider specific 
actions. One would probably be reasonably aiccessful in modeling this type 
of plan using production systems, in this case, specific features of the 
environment would automatically evoke particular responses. This type of 
behavior falls into the category of class No. 3 programs as defined in the 
time-sharing computer analogy introduced earlier. Realistic examples of 
application of this idea include aircraft attitude instrument flying [26] 
and air traffic control [27] . 

Given a set of candidate plans, the human must forecast or imagine the 
consequences of implementing each plan. One might assume that the human 
performs some type of mental simulation of the plan. For example, the 
human might use his current perception of the system dynamics to 
extrapolate the system s state as a function of planned control strategy, 
house has developed a model that describes this type of behavior. 
Succinctly, the model assumes that the human has both a long-term and 
short-term model of the system with which he is dealing and, that he uses a 
compromise between the two state precictions obtained from these models as 
a basis for decislcn making [28] • 

however, when plans are sketchy, at least in terms of intermediate 
preconditions, the human probably does not actually calculate consequences 
but instead simply maps plan features to previously experienced 
consequences. Then, until evidence forces him to reject the assumption, he 
assumes these previously experienced consequences will prevail. This type 
of behavior is represented quite nicely by the scripts concept [22]. 
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Imagined consequences are then compared to goals. For low level 
plans, the comparison might be based on a well-defined criterion function, 
however, this is probably not the case for high level plans. Since high 
level goals and Imagined consequences may be verbal and rather vague, it is 
likely that the human only tries to satisfice rather than optimize. One 
might represent this phenomenon using multi-attribute utility functims 
L29J that have broad- optima . Alternatively, concepts from fuzzy set theory 
t30j, l 31] might be used to consider the membership of a set of 

consequences in the fuzzy set of acceptable consequences. The utility 
function approach is probably apprqjriate if one assumes that the human has 
a fairly precise knowledge of the possible consequences, and subsequently 
values some more than others. On the other hand, the fuzzy set approach 
would seem to be applicable to situations where the human s perception of 
the consequences is actually Aizzy. 

The human chooses the most satisfactory plan and initiates its 
execution. If none of the available plans meets an acceptable level of 
satisfaction, the human either tries to debug the set of plans under 
consideration or perhaps tries to develop new plans . Debugging of 
partially failed plans may initially involve local experimentation to 
determine the cause of plan failure rather than a global reevaluation and 
complete replanning [32] . One approach to modeling debugging or 
trouble-shooting of plans is with fuzzy set theory [33], 

Assuming that a plan has been initiated, the human monitors its 
execution and only becomes involved (in the sense of planning) if the 
unanticipated occurs or executiai reaches the point that some phase of the 
plan must be more concisely defined. Monitoring for the unexpected might 
be modeled using production systems that trigger when the preconditions are 
not satisfied. Other approaches, based on filter theory [3^] or pattern 
recognition methods [35], are also available but beyond the scope of the 
discussion here. 

Once the unexpected has been detected, planning might shift into the 
above mentioned debugging mode. • On the other hand, the need to shift from 
sKetchy to concise planning may involve abandoning, lor the moment, the 
broad hierarchical mode and shifting to a detailed partially pre-programmed 
mode. 


How do all these bits and pieces fit into an overall model of 
planning? While it does seem that the hierarchical approach to planning 
combined with the production system and script ideas provide a reasonable 
framework, the state-of-the-art certainly does not allow one to construot a 
context-free planning model in the form of an executable computer program. 
This may be an inherent limitation if one accepts the premise that much of 
human behavior is merely a reflection of the task environment [1], If this 
premise is true, then one should be very careful that laboratory 
abstractions capture a sufficient portion of the real world environment and 
thereby allow results to actually be transferable. Otherwise, one is only 
developing a theory of human behavior in laboratory {^mes. 




i«vo/?/ *^"u^ comment on planning, a very important issue concerns the 
an planning behavior should be addressed. While 

neuron level [ 36 ] aax eventually lead to a successful 
^ccLa^in*^'JIf” ‘behavior, such an approach is unlikely to lead to 

ftJ l 14 ® "®®*’ ^Iteratively, one might try to develop models 

thii predict whether or not a plan will be successful. However 

Drocess^*^*Tt*^ model would yield little information about the planning 
4 4 !!”® approach studies on the conscious planning 

If t ‘37], (381 or at leaaVJ^S 
explicitly measurable. Then, the varietv of 

tf '^’‘'*3,*"® in thta aeotion oa,! ba appUad to 

describing the planning process . hp a to 

IMPLEMENTING PLANS 


Implementing plans refers to human action, mainlv controiUntr and 
reaching in the Jiulti-level structure of Figured Two an ® t 

for Mthaaatlcally daaorlblpg thaaa aotionf ean La diat if^lahaS ?ha 

first approach includes time-line analysis, queueing theorv and simniaMnn 

‘»a control thaoratio approach In a 

tii»-Una analysaa, the execution timea of all particular taak 

f f 0 °^..° “'■‘“3" Situation are aaaaaaad aa wf 1 L Sa 

‘f ‘i ‘vallabla tine «arsina“r 

Sume tiSl n^ff . •>« tnloulated in o?dar to 

u ^ ^ system performance and human operator workload Thi.» 

Takl^ tfaaf fnafr,'" “’'“^uating rather conplax" man-irirfyaiaaf;; 

J^i^a^offiUralitfhaf.'’ ='® ' -aching 

£11] \^?r'flt3?“‘rT« “a duaualng theoretic one 

amliala 'hut ,i J A'- ‘a ‘ ‘^'l. It is suitable not only for 

analysis but also for design purposes. The different tasks of - 

ultl-task situation are considered as customers in a queue waiting to he 

aaryicad. Arriyal and aarvloe rates as veil as the ualX u„ 7»r th! 

Doaalbl^™ oharaoteriatlo neasurea. Service with a priority policy is 

l^’rra ^rTa fot^l' tfkf ® 

on^fn *d°”* 4 4 .K® taken into account, these methods have to be 

coabined with others. Simulation techniques seem to be a reasonable 
approach where micro-subroutines simulate dynamically such huLn ope 
behaviors as short-term memory recall and movement of hands and feet Hifll 
This leads back to the time-sharing computer analogy a 
priority interrupt structure for handling all tasks approp?iat7lC in f 

Sifloiai promising. However, this results in a more 

artificial-intelligence oriented simulation^ usinc heuristio^ anH 

handling algorithms, rather than an analytical description. * 
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A different approach for the description of human actions in 
man-madiine systems applies control theory. Models for continuous manual 
control are well established. Numerous summaries in the forms of reports 
and books exist (e.g., [493, [50], C513). Most popular are the 

quasiolinear and the optimal control models. The quasi-linear models 
describe the human control behavior by some task-specific modification of a 
generalized transfer function which is best satisfied in the crossover 
frequency region for many controlled element dynamics. In additicn, an 
internal human noise source (the remnant) summarizes the portion of the 
human's output which cannot be explained linearly. 


The optimal control model [52] includes two noise sources and also has 
a time delay and a neuromuscular lag term with a time constant similar to 
that of the quasi-linear model. A Kalman filter estimates the states of 
the controlled element, whereas a predictor compensates for the time 
The optimal gains are calculated with respect to a criterion function which 
is a weighted sum of mean squared values of state and control variables. 

The control theory models have been aoplied in several domains 
including aircraft piloting, automobile driving, ship piloting, and 
anti-aircraft artillery. Further, several display design methodologies 
have been developed. A recent special issue of HUB i a Jl £ aotQC a reviews many 
applications of control theory models [533 • 

With both the crossover model and the optimal control model, a 
stochastic reference input, either forcing function or disturbance, has 
been assumed. Therefore, these models are mostly applicable to the inner 
loops of manual vehicle guidance and control tasks. In the case of the 
optimal control model, key elements of this have also been applied to 
monitoring and decision-making tasks. 


Many realistic tasks exist, however, in which deterministic inputs are 
domimnt. Taking the baseline car driving scenario as an example, a more 
complicated deterministic input exists, i.e., the course of the street. 
For this task, a two-level model has been proposed which has a closed-loop 
stabilization controller and an anticipatory open-loop guidance controller 
working in parallel [54], [553. The perceptual aspects of the anticipation 
of changes in the course of the street have been explained. However, it 
has been assumed that the driver tries to eliminate all deviations from the 
middle line of the street. 


To overcome this simplification, the street might be viewed as a 
target tube in which the driver is allowed to move his car. Interestingly 
enough, many other human control tasks in vehicle guidance and industrial 
process control also require controlling the state of the system within a 
target tube rather than along a single reference line. Such a criterion 
makes these tasks much more relaxed than one often assumes in man-madJine 
systems experiments . 

Reviewing the control theory literature, some applicable methods for 
controlling within a target tube were found. They have never been used 
with man-machine systems problems. One approach assumes a criterion 
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Figure 45 Schematic Presentation of the State of the System (X) 
as Affected by the Action of the 
Controller (C) to Counteract Disturbances (N) for 
Reachability of a Target Tube 
(from (573) 

The unknown-but-bounded control approach combines state variable with 
oAt- (■hoopetle desoriotions. Due to the higher mathematical effort, this 
»prlrn“a Wr^Xtr, b..n appli«l In autc^tlo control 
However it seems worthwhile to consider this approach in modeling 
biological or sociological systems. Human behavior in general is 
giai-lriented and the goal is very often defined as brining or keeping 
some state variables within a certain target set or target tube. 

in the baseline scenario, the target tube of Figure *» 

the street or one of its lanes. The effective target tube is 
Dlanned by the driver as an area inside of which no control »®bions a^ 
n«d«o.i^rv (see linear-plus-dead-band control laws in Glover and Schweppe 
?5«r Planning the Tfoct“^ targot tub. might alao InoUd. ao» 
f^^ziwss Whether the unknown-but-bounded control approach can be 
Swd with fu«y set theory which has recently been applied in 
industrial process control [601 has not as yet been investigated. 

another interesting issue is the notion of the internal model which 
h.. «nal*wd tS oome «xt«.t In th. dlaouaalm of th. planning 

l“ mdellng how th. human ohooa.s among altomatlv. oouraoa of 
Lu”?’an lm“rSnt‘laau. oonom.5 -hathar th. human poa,.n»,. a oorraot 
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internal model of his environment or, whether the model is incorrect as in 
learning situations or, very approximative as in large>scale systems (see, 
(6lj). The process of building up an internal model during learning 
and how to ure it by changing control laws or choosing among different 
kinds of control laws in time-varying systems, should be further 
investigated. The literature on adaptive manual control shows, for 

example, that the models assume a set of predetermined control laws matcned 
with a set of different system dynamics (see e.g. , [62]). 

This leads to the idea of a memory for motor patterns. Instead of 
having an input-output transfer behavior, the human operator initializes 
predetermined motor patterns in many situations. These patterns are 
slightly corrected during their actual execution (see, e.g., ( 63 )). Good 
examples are walking, bicycle riding, and piano playing. Also, the 

coordination and timing of a aeries of discrete manual control actions, 
e.g., in trouble-shooting tasks or in checking procedures of aircraft 
pilots or process operators, can be explained by predetermined motor 
patterns. 


DISCUSSION AND CONCLUSIONS 


In considering various approaches to tying all of the discussions in 
this paper together, the authors found the diagram in Figure 5 to be most 
use^l. This diagram is a variation of a diagram discussed by Johannsen 
[64] for vehicle control tasks and Sheridan [1976] for human control of 
vehicles, chemical plants, and industrial robots. 


r 


Humoft 

-L. 

) 



Figure 5: Hierarchy of Human Behavior 
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represent well-defined man-machine systems 
tMks such as those discussed by Johannsen [64] and Sheridan [65] as well 

aJfjl ^ t outline, subplans could mean a scheme to 

wcceed in a specific job, and actions could mean one’s dally activities 
Thus, the diagram has broad applicability. ^ activities. 

looks“'2: ® deacription? If one 

c«trol wito perspective that includes 

respect to continuous events as well as discrete events, then 

o^JueiM «"»^y*^ioal methods (e.g., linear systems theory and 

queueing theory) within the category of control theorv This 
generalization, and willingness to expand the set of tools one utilizes 

Of . Uer poftioo ocZ\ o^ 

there”??7h' ^*’**’® f limits to context-free analytical modeling. First, 
task enviroMeirt*^ Important idea that human behavior mainly reflects the 
MMrai 7^“*" aearchlng for a specific analytical model of 

‘••havior may only be fruitful to the extent that all task 
common. Perhaps then, one should first search for 

In^hei wJrSr"f i'^trinslo human characteristic^ 

reasonable init demands of the environment may allow a 

prediction of human performance. Thus, it is reasonable 

“• »f «•« ‘"K 

Of aniijn«l? analytical modeling is due to the human’s lack 

of ^*’^”‘1^"®* aapacially at upper levels of the hierarchy. First 

JJ: * aatisficer than an optimizer Thw idel^ 

auch as a target tube within control tasks, fuzzv set i-hef,t.» 
occiiC0Dt^s Tt^otR util ■! ft# A t y s^v vu^ony I iind sotnii^ 

man-^SlnV avsteii .iff®'*''* application within 

onM?--;?!. ayatems. What this means is that one should look at 
optimization with respect to broad criteria that allow muitinie 
Mtisfaotory solutions, kn alternative approach to this issue is 
d scard optimization, but this would leave the^doler stripped o? one Ir 
his most important tools and without a viable altemative. 

Beyond the idea of satisficing, another important iiniisiinn 
ara^tical modeling is that husmns simply do not worry about details unMi 

wQrKioao ana a4ao, that the huinan has the resources imft 


1<1*» pr„»nt« ■ proMea, WhU, evaryom niiht 

’* °^L. 1» "Ot •ufflclont to prodtol porfonu^o On. 

«g.t knw vbat tbo porlpt ppMiricu, i,. ihup, In co.pJ.rtMW oJ! 
«..t ««.« not onl, p.rfom.„o. .rror) lot MM'tSrSortp" 
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This suggests that verbal protocols (perhaps analyzed by a computer that 
understands natural language) may be Inoreaslngly important research tools. 

To oonolude« this paper has presented a fairly general, but an inly 
verbal, model of human behavior in complex tasks. The ideas discussed have 
been based on analysis of a specific complex task (car driving) as well as 
a thorough review of the literature. Three very specific ideas have 
emerged. First, control should be looked at in a broad sense, 
incorporating a wide range of analytical methodologies. Second, the human 
satisfioes rather than optimizes and criteria should reflect this. Third, 
hlgher-level activities such as planning require approaches that allow 
incompleteness, and approaches that capture the process of these activities 
and not just the results. 
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